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Abstract 

We investigate the effect of sterile neutrinos that are nearly degenerate with active ones on 
the flux of ultrahigh-energy cosmic ray neutrinos at earth. This offers a way to probe neutrino 
oscillations in the mass-squared range 10-i6gv2 < < IQ-ii eV^ which maybe hard to 
detect by any other means. Taking into account the present experimental uncertainties of the 
active-active mixing angles and by allowing any values for the active-sterile mixing angles we 
find that the ratio of the electron and muon neutrino fluxes may change by -40% to 70% in 
comparison with the ratio in the absence of active-sterile mixing. 
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1 Introduction 



Neutrino telescopes will measure the relative fluxes of ultrahigh-energy neutrinos fg, '^ti, i^r 
created in distant astrophysical objects like active galactic nuclei (AGN) and gamma ray bursts 
(GRB). The fluxes measured at earth are in general expected to difl'er from the initial fluxes 
at source due to the oscillations of neutrinos during their flight A general assumption is 
that the initial flux at source has the composition as $g : <I>JJ : <I>^ = 1 : 2 : (making no 
distinction between neutrinos and antineutrinos) since neutrinos are thought to be produced 
in the pion decays n ^ ^ + and in the subsequent muon decays ^ — > e + Ue + i^^. The 
measurement of the flavour composition of ultrahigh-energy neutrinos in terrestrial detectors 
will thus provide us with information about the neutrino mixings (2], PI- In particular, if the 
atmospheric neutrino mixing is maximal, as the data suggest, the observed ratio is expected 
to be approximately ■ '■ = ^ ■ ^ '■ ^ irrespective to the value of the solar mixing 
angle OOj- (For recent works on the subject, see e.g. QUEUED- 

A sterile neutrino, if mixing with active neutrinos, might have large effects on the fluxes 
of ultrahigh-energy neutrinos, easily detectable in the future neutrino telescopes The 
existing data on solar and atmospheric neutrinos combined with the recent results of the 
KamLAND reactor experiment [Jj clearly rule out active-sterile mixing as a dominant mixing 
mode of neutrinos jH]. Nevertheless, substantial sterile components in the neutrino flavour 
states are still allowed On the other hand, the recent precise determination of 

various cosmological parameters, by the WMAP (13], 2dFGRS [Hj, CBI [IS], and ACBAR PH 
experiments, puts strong constraints on the number of relativistic particle species present at 
Big Bang Nucleosynthesis and on the amount that neutrinos contribute to the critical density 
of the universe. A population of sterile neutrinos in the early universe, created and maintained 
by oscillations, would contradict these constraints unless the active-sterile mixing and/or the 
relevant mass-squared differences are sufficiently small [TJj. Whether there already exists a 
conflict with the LSND oscillation result [l^ is still in dispute [T9l I2n| . 

In this paper we shall study the effects of active-sterile neutrino mixing on the fluxes of 
ultra-high energy neutrinos on their arrival at earth. It should be emphasized that irrespective 
of the fact that sterile neutrinos are possibly playing just a marginal role in the solar and 
atmospheric neutrino oscillation phenomena and of whether the LSND result is verified or not, 
sterile neutrinos may well exist in such regions of the (sin^ 29, dm^) parameter space that are 
not probed in these experiments at all. As long as the mass-squared differences are in the range 
5m? > 10^^^ eV^, active-sterile neutrino mixings can have measurable effects on the UHECR 
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neutrino fluxes. On the other hand, if the mass-squared difference is smaller than about 10^ 
eV^, the smallest difference one can probe with solar neutrinos, the active-sterile mixing would 
have remained unnoticed in all existing experiments. The UHECR neutrinos offer a way to 
probe neutrino oscillations in the mass-squared range 10"^^ eV^ < dm^ < 10^^^ eV^ which 
may be hard to detect by any other means. Our objective is to study the effects of oscillations 
in this range. 



2 The influence of neutrino osciUations on neutrino fluxes 



In three flavour framework the flavour fields t'e, t'^, and Ur and the mass eigenfields z/i, i>2 and 
i>3 are related by a 3 x 3 mixing matrix U as 



U 



1^1 
V ^3 / 



where 



U 



\ Url 



Ue2 
U^2 
Ur2 



Ue3 ^ 
Ur3 j 



C12C13 
-S12C23 - C12S23S13 
\ S12S23 - C12C23S13 



S12C13 Sl3 
C12C23 - S12S23S13 S23C13 

-C12S23 - S12C23S13 C23C13 y 



(2) 



and, neglecting the possible CP violation, Cjk = cosOjk and Sjk = sin^j^. The solar neutrino 
data together with the recent KamLAND reactor data [Zj single out the so-called large mixing 
angle solution, with mixing angle 612 bounded into the range 0.49 < 612 < 0.67 fHj. On the 
other hand, observations of atmospheric neutrinos are consistent with maximal mixing of the 
mass eigenfields 1^2 and 1^3, allowing for a mixing between them in the range 0.63 < ^23 < 0.94 
|21| . The third mixing angle, ^13, is bounded to small values, < 6*13 < 0.1, by the non- 
observation of oscillations in CHOOZ (22] and Palo Verde jSH] experiments. A one-parameter 
matrix that is consistent with these limits is 

C12 S12 ^ 

-S12/V2 C12/V2 I/V2 , (3) 
\ S12/V2 -C12/V2 I/V2 J 

which corresponds to sin0i3 = and maximal atmospheric mixing sin 2^23 = 1- 
The observed flux of the neutrino flavour ui at earth, is given by 



(4) 



3 



where Pw is the probabihty of the transition vii — > f/, 

Pw = Sin - E u;,,UuU,,Ut,{l - e-K— (5) 

and is the flux at source. For UHECR neutrinos the distance of flight L and energy E vary 
so that P;/' averages to 

i 

If the mixing happens according to the matrix JHl), the flux ratio at the earth is ^>e : : 
$T- = 1 : 1 : 1 irrespective of the value of the solar mixing angle 9i2. When the values of the 
mixing angles ^13 and 623 vary in the range allowed by experimental data, this ratio may have 
values within the gray boomerang-shaped area of Fig. 1 (see below). From observational point 
of view the fluxes and are more interesting than the flux of the tau neutrino as they 
can be determined probably more precisely than The present oscillation data allows their 
ratio to vary in the range 0.75 ^ '■ ^ 1.17, where the lower end corresponds to 623 = 54° 
and the upper end to 623 = 36°, which are the largest and smallest value of the mixing angle 
023 that experiments allow. 

3 Effects of sterile neutrinos 

We shall now consider the situation where there exists a sterile neutrino (neutrinos) that mixes 
with active neutrinos so that the ensuing new mass eigenstate is nearly degenerate with another 
mass state. As mentioned earlier, if the mass-squared difference 6m'^ of the two states is in the 
range 10~^^ eV^ < 5m'^ < 10^^^ eV^, the existence of the sterile flavour would have escaped 
detection in the oscillation experiments performed so far, but they could, at least in principle, 
have measurable effects on the fluxes of the UHECR neutrinos. We will now study how large 
these effects could be. 

Let us first assume that there exists just one sterile neutrino which mixes with the 
superposition of the active states that constitutes the mass eigenstate z/3. Let us denote the 
mass eigenstates in this four-flavour scheme as follows: 

i^i = 

1^2 = 2^2 

V3 = cos if 1)3 — sin if Vg 

= sin ip V3 + cos 99 Vg ■ (7) 
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We assume that the mass difference of the states 1^3 and 1/4 is so small that in the processes, 
like particle decays, which are measured in laboratory experiments, these two states are not 
distinguished but appear as a single state with couplings equal to those of the state z/3. If 
l'^"^34l — 1^1 ~ ""^il ^ 10^^^ eV^, the existence of the fourth state had not been revealed in 
neutrino oscillation experiments performed so far. In this range of the mass-squared difference 
there is no limitations for the value of the mixing angle ip from the existing data. 

The neutrino mixing matrix is in this case given by 

/ TLi r/oo COR 03 ILt sin 03 TL'j \ 



^(4) 





Ue2 


COS 99 Ue3 


sin 99 Ue3 




U^2 


COS ip U^3 


sinip U^3 




Ur2 


COS If Ur3 


sin 99 Ur3 








— sin if 


COS ip 



(8) 



y u u — sm if cos ip j 

where Uu are elements of the 3x3 matrix Q. This active-sterile mixing suppresses the 
transition probability Pi[i according to 

PlV = \Ullf\Uvi? + \Ul2?\Uv2? + ^3 • \Ul3?\Uv3? , (9) 

where /' = e, and we have denoted ^3 = cos"^ + sin^ ip. 

The suppression factor has a value within ^ < 5*3 < 1 depending on the value of the 
mixing angle ip. This generalizes straightforwardly to the case where all three mass states are 
accompanied, as a result of active-sterile neutrino mixing, by a nearly degenerate new mass 
state. In this case the transition probability is given by 

Pw = Si ■ |C/nP|f//'lP + ^2 • \Ul2f\Ui>2\^ + S3 ■ \Ui3\^\U,3\^ , (10) 

where 

Si = cos'^ ipi + sin^ ipi (11) 

(i = 1, 2, 3) and ipi is the mixing angle between the mass state Ui and the accompanying sterile 
state Usi. In general the factors Si varies in the range ^ < S'i < 1 independently of each other. 

Obviously, this is not the most general mixing scheme between three active and three sterile 
neutrinos. In general the mixing of six flavours depends on 15 rotation angles while we describe 
the mixing in terms of just six angles {9ij,ipi; i,j = 1,2,3). Nevertheless, we consider this as 
an interesting special case, and we also believe that it provides us with a generic picture of the 
effects of active-sterile mixings on the UHECR neutrino fluxes, at least as far as the size of the 
effect is concerned. 
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A theoretically relevant question is how to achieve a high degeneracy between the active 
and sterile states at the same time with a large mixing. In the simplest scheme there are two 
mass scales involved, one (m) that gives the absolute mass scale and another (/x ~ V dm?) 
that determines the mixing. The mixing angle in such a case would obey <^ ~ fJ-fm, and it is 
small except in the case where the absolute mass scale and the mass difference are of the same 
order of magnitude. Without pursuing the issue further and considering more sophisticated 
mixing schemes we just note that in this simple picture only the lightest of the three standard 
neutrino mass states could have a sterile partner with Sm^ < lO"-*^^ eV^ as the overall scale of 
the neutrino mass spectrum, in contrast with the mass differences, is not fixed by the present 
experimental data leaving the mass of the lightest neutrino free. 



4 Results 

Let us now look at the effect of the active-sterile mixing on the fluxes of the active neutrinos 
measured in terrestrial detectors. The ternary plot of Fig. 1 presents the relative fluxes Fi 
{I = e^ji^r) of the active neutrinos u^, f^, Vt at earth, where 

(12) 



It is assumed in this plot that the initial fluxes of different flavours at source are given by 
the standard ratio $g : $° : = 1 : 2 : 0. The gray area corresponds to the situation where 
all the sterile neutrinos decouple, i.e. = for all i = 1,2,3 (or the degeneracies are such 
that dvr? < 10~^^ eV^), and the mixing angles of the 3x3 mixing matrix are varied in their 
phenomenologically allowed ranges (0.49 < Qyi < 0.67, 0.63 < 6*23 < 0.94 and < 6'i3 < 0.1). 
(We shall call this the SM case.) The black area is obtained by allowing the active-sterile 
mixing angles (pi vary freely (the sterile-mixing case). 

The phenomenologically most interesting is the flux ratio of the electron and muon neutri- 
nos, 

i^e^^l^. (13) 
In the SM case this ratio varies in the range 

0.75< (i?e;.)sM< 1.17, (14) 

for the present accuracy of the mixing angles Oij. In the sterile-mixing case one has 

0.47 <(i2e;.)sterile< 1-62. (15) 
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Figure 1: Relative fluxes of the UHECR neutrinos at earth. The gray area corresponds to 
the situation with no sterile mixing and the standard mixing angles 9ij varying within the 
experimentally allowed ranges. The black area, in part behind the gray area, corresponds to 
the situation with three sterile neutrinos with arbitrary mixing angles ifi. 



The relative deviation of the ratio Re^ from its SM value, caused by the sterile mixing, varies 
approximately in the range 

-40% < (-^^M)sterile - {Re^.hM < ^^^^ _ ^^g^ 

The largest positive deviation is achieved when the sterile mixing angle ipi is very small 
and the other two 992 an '/'s are nearly maximal (a representative set of values being 991 = 
3*^, 992 = 37°, 993 = 44*^), while the largest negative deviation is obtained when Lpi and 992 
are nearly maximal and 993 is very small {(pi = 43*^, ip2 = 45°, (p^ = 0.02°). In the former 
limit the flux ratios are approximatively : (^fj_ : = 0.4 : 0.3 : 0.3, in the latter limit 

'■ ^ '■ = 0.2 : 0.5 : 0.3. The effect of the active-sterile mixing to the relative fluxes can 
thus be quite large and easily detectable in the future neutrino telescope experiments. 

Let us consider the situation of just one sterile neutrino mixing with active neutrinos 
with the other two sterile neutrinos decoupling. Such a situation is described by the mixing 
matrix (jHl, where = 9?2 = 0. In Fig. 2 we present a ternary plot corresponding to this 
situation. To see how the deviation from the SM case depends on the active-sterile mixing 
angle, we have plotted in Fig. 3 the maximum and minimum values of the ratio R^^ as a 
function of ip^ when the rotation angles of the 3x3 mixing matrix vary in their experimentally 
allowed ranges. As can be seen from this figure, the SM result and the sterile mixing result do 
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Figure 2: Relative fluxes of the UHECR neutrinos at earth. The gray area corresponds to 
the situation with no sterile mixing and the standard mixing angles 9ij varying within the 
experimentally allowed ranges. The black area corresponds to the situation with one sterile 
neutrino with arbitrary mixing with the heaviest neutrino. 

not overlap when the active-sterile mixing is close to maximal. The flux of electron neutrinos 
increases in comparison with muon neutrinos with increasing (j)'^. At the same time the relative 
flux of tau neutrinos remains nearly unchanged. 

In the near future there will be many new experiments that will improve our knowledge 
of the values of the mixing angles Oij . Let us explore how this would affect the sensitivity of 
UHECR neutrino measurements in probing the sterile mixing. We follow ^ and anticipate 
the following ranges for the mixing angles: 0.54 < 612 < 0.63, j x 0.9 < 623 < f x 1.1 and 
< ^13 < 0.1. The relative fluxes of neutrino flavours at earth in this case are presented in 
Fig. 4, where the gray area corresponds to the situation with no active-sterile oscillations. The 
ratio of the electron neutrino and muon neutrino fluxes varies in the absence of sterile mixing 
in the range 0.88 < (i?e^t)sM ^ 1.13, while in the presence of three sterile-neutrino oscillations 
with arbitrary mixing angles the variation happens within the range 0.58 < Re/j, < 1.57. 
Comparison with ifTHl and (|TK|l reveals that improving the accuracy of the determination of 
6ij would not substantially affect the distinctiveness of sterile neutrino signal in the UHECR 
neutrino flux. 
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Figure 3: The ratio of the fluxes of electron and muon neutrinos as a function of the sterile 
mixing angle (/?3. The area between the solid lines corresponds to the experimental uncertainty 
of the standard mixing angles 9ij. The dashed lines indicate the situation in the case of no 
sterile mixing. 

5 Discussion 

If one assumes the conventional production mechanism of ultrahigh-energy neutrinos in astro- 
physical sources, the three neutrino flavours Ue, z/^, Ur arrive at earth approximately in the 
flux ratios 1:1:1. We have investigated how these ratios are changed if the active flavours form 
with hypothetical sterile neutrinos nearly degenerate mass state pairs with mass-squares in the 
range 10^^^ eV^ < 6m'^ < 10^^^ eV^. The effect would be detectable in future experiments, 
such as the IceCube |24J, ANTARES |25j and NESTOR (SI, which will improve the sensitivity 
to ultrahigh-energy neutrinos by 2 to 3 orders of magnitude during the next decade |27| . 

We have tacitly assumed in our analysis that neutrinos do not decay during their flight 
from the source to terrestrial detectors. In the standard model framework this certainly is a 
safe assumption as the experimental limits on the magnetic moments of neutrinos imply that 
the decays Ui Uj + are very slow and completely irrelevant for our flux considerations. If 
one extends the model to include majorons (J), light scalar particles that appear in theories 
where global lepton symmetry in spontaneously broken j2H|, new decay channels, z/j Vj + J, 
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Figure 4: Relative fluxes of the UHECR neutrinos at earth. The gray area corresponds to the 
situation with no sterile mixing and the standard mixing angles 9ij varying within the antic- 
ipated sensitivity ranges of future experiments. The black area corresponds to the situation 
with three sterile neutrinos with arbitrary mixing angles ifi. 

are open that could be rapid enough to cause detectable modulation of neutrino fluxes jSH]- If 
these decay do take place their effect could overrule the effect of the sterile mixing considered 
in this paper jSHI- 

We have assumed above that the initial flux composition is the canonical one, i.e. $g : 
: = 1 : 2 : 0. It has been argued that the muons produced in pion decay can lose energy 
e.g. in strong magnetic field of the source so that no ultrahigh-energy electron neutrinos are 
available [H^ (see also (HSI)- In this situation the initial flux composition is $g : : <I>^ = 
0:1:0. We have checked this case, and it turned out that there the effect of sterile mixing 
is smaller than in the canonical case: in the presence (absence) of sterile neutrinos one has 



Let us finally consider the existence of the three sterile neutrinos of our picture from the 
point of view of cosmology. One possible cosmological effect of sterile neutrinos is related 
to the Big Bang nucleosynthesis. As is well known ^Jj active-sterile mixing might bring - 
depending on the values of the mixing angle and mass-squared difference - sterile neutrinos in 
equilibrium with active neutrinos before neutrino decoupling and the resulting excess in energy 
density would endanger the standard scheme for the nucleosynthesis of light elements. This 
argument leads to the following bound for <-> i^s mixing (HE]: \Sm^\ sin^ 2a < 5 x 10"^ eV^ 
and to slightly less stringent bounds for other flavours. Obviously, this constraint has no 



0.19 < Re^. < 1.10 (0.25 < i?e^ < 0.93). 
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consequence in our case as we assume < 10^^^ eV^. In other words, neutrino oscillations 
will not produce and maintain a significant sterile neutrino population. This also means 
that the conclusions one draws from the first results from WMAP satellite experiment |T3j . 
are not affected by the sterile neutrinos we are considering. The WMAP experiment, which 
measures the fluctuations of the cosmic microwave background radiation, leads to the bound 
n^h^ = ^^mi/93.5eV < 0.0076 (95 % CL) for the total energy density of neutrinos. This 
implies the limit Yli f^i < 0-69 eV for the sum of masses of all neutrino species. In our case only 
half of six neutrino species contribute to this sum as the number density of sterile neutrinos 
is negligible. Hence, when the bound is saturated, all neutrinos are nearly degenerate and all 
three masses rrii {i = 1,2,3) have the upper limit rrij < 0.23 eV, just like in the case of no 
sterile neutrinos. 
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